Evaluating Collaborative Modeling Processes Towards Understanding and Supporting Collaborative Modeling Games

Collaborative modeling is an approach aimed at enhancing productivity in Systems Design. Such an approach brings together stakeholders with varying degrees of skills and knowledge. Although much attention has been paid to the models created, little empirical work has focused on the modeling process itself, especially its evaluation. This raises the question whether an approach for analyzing and evaluating modeling processes exists yet. We aim to analyze and evaluate this neglected aspect. With the help of a three-tier framework, and by taking a game design theoretical approach to modeling, we identify the different aspects that drive the modeling process. We use this framework to develop an understanding of the inner structure of the modeling process with a view of evaluating it. We give some preliminary results to illustrate our framework and sketch an outline of future scientific inquiry to refine and tighten this framework.